Two-hidden-layer feed-forward networks are universal approximators: A constructive approach
نویسندگان
چکیده
منابع مشابه
Deep Belief Networks Are Compact Universal Approximators
Deep Belief Networks (DBN) are generative models with many layers of hidden causal variables, recently introduced by Hinton et al. (2006), along with a greedy layer-wise unsupervised learning algorithm. Building on Le Roux and Bengio (2008) and Sutskever and Hinton (2008), we show that deep but narrow generative networks do not require more parameters than shallow ones to achieve universal appr...
متن کاملMultilayer feedforward networks are universal approximators
This paper rigorously establishes thut standard rnultiluyer feedforward networks with as f&v us one hidden layer using arbitrary squashing functions ure capable of upproximating uny Bore1 measurable function from one finite dimensional space to another to any desired degree of uccuracy, provided sujficirntly muny hidden units are available. In this sense, multilayer feedforward networks are u c...
متن کاملUncertain Systems are Universal Approximators
Uncertain inference is a process of deriving consequences from uncertain knowledge or evidences via the tool of conditional uncertain set. Based on uncertain inference, uncertain system is a function from its inputs to outputs. This paper proves that uncertain systems are universal approximators, which means that uncertain systems are capable of approximating any continuous function on a compac...
متن کاملDeep, Narrow Sigmoid Belief Networks Are Universal Approximators
In this note, we show that exponentially deep belief networks can approximate any distribution over binary vectors to arbitrary accuracy, even when the width of each layer is limited to the dimensionality of the data. We further show that such networks can be greedily learned in an easy yet impractical way.
متن کاملMonotone Boolean Functions Are Universal Approximators
The employment of proper codings, such as the base-2 coding, has allowed to establish the universal approximation property of Boolean functions: if a sufficient number b of inputs (bits) is taken, they are able to approximate arbitrarily well any real Borel measurable mapping. However, if the reduced set of monotone Boolean functions, whose expression involves only and and or operators, is cons...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Networks
سال: 2020
ISSN: 0893-6080
DOI: 10.1016/j.neunet.2020.07.021